WIT 


70C-010-50a 
Computers 


User Ratings of 
General-Purpose Computer Systems 


it’s a Matter of Opinion 


As Datapro’s subscribers keep telling us, a summary of 
users’ evaluations of the pros and cons of the myriad 
products offered to the data processing community can be 
a valuable tool in selecting the product that will best meet 
each computer user’s needs. That kind of information is 
often hard to come by, however, which accounts for the 
increasing popularity of the “User Reaction” sections of 
Datapro’s reports on computer systems, proprietary 
software, and peripheral products. 


This 1975 survey of user ratings of general-purpose 
computer systems summarizes the opinions of Datapro 
subscribers about their currently installed computers and 
presents weighted averages of the ratings assigned to each 
computer system for its performance in 12 important 
categories that cover hardware, software, and the 
supporting services provided by the computer manufac- 
turers. These ratings provide a quick and easy-to-use 
method for prospective computer purchasers to determine 
what other users (in this case, DATAPRO 70 subscribers) 
think are the most attractive characteristics, as well as the 
disadvantages, of the computer systems they are now 
using. Datapro solicited these views in an extensive 
questionnaire that was mailed ona postpaid reply form to 
a sample of 8,200 Datapro subscribers in June 1975. 


By August 1, when the monumental task of tabulating the 
returned questionnaires was begun, a total of 2,041 
responses had been received—just about double the 1,016 
responses reporting on general-purpose computer systems 
that were received in Datapro’s 1974 survey of 
general-purpose computer users. 


All general-purpose computer systems of any vintage were 
grouped and included in the tabulated listings if they were 
rated in two or more user responses. Single responses 
describing a particular model of a computer manufac- 
turer’s product line were incorporated into the totals for 
the appropriate computer family under the category of 
“others.” 


In the case of questionnaires that described two or more 
computer systems representing two or more distinct 
models within a product line, each set of ratings was 
counted as one response. However, when only one set of 
ratings was given for multiple computer systems of the 
same model or series, that set of ratings was counted as a 
single response in order to avoid skewing of the final 
ratings by one installation reporting on a large number of 
identical computer systems. As a result, our 1975 survey 
summarizes the ratings supplied in 2,041 responses 
evaluating a total of 2,381 computer systems. 


A word of warning to those whose first response is to 
compare each manufacturer’s 1975 overall ratings with 
those achieved in the 1974 Datapro survey: Not only do 
these ratings represent nearly twice the number of 
computer systems rated in the 1974 survey—2,381 
compared to 1,288—but they also include some computer 
systems that were not included in last year’s ratings. 
Systems represented in the 1975 survey for the first time 
include the Burroughs B 300 and B 500, the Honeywell 
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This report conveys the results of Datapro’s 1975 
survey of general-purpose computer users. Extensive 
tables summarize the experience of 2,041 users with 
a total of 2,381 computer systems. The users’ 


ratings pinpoint the strengths and weaknesses of 
each mainframe manufacturer’s equipment, soft- 
ware, and support, yielding information that should 
be of great value in computer acquisition. 


Model 58, the IBM 1800, the NCR Century 50, and the 
Xerox 530, all of which previously were included in the 
user ratings tabulated in two other Datapro reports, All 
About Minicomputers and All About Small Business 
Computers. Naturally, recently announced computer 
systems, such as the Honeywell Series 60, the UNIVAC 
Series 90, and the IBM System/32, are also included for 
the first time in the responses for 1975. 


In addition to the 2,041 responses tabulated in this 
report, Datapro’s 1975 computer survey also attracted 
responses from 699 minicomputer users with a total of 
2,182 installed systems. The minicomputer users’ ratings 
are tabulated in a separate DATAPRO 70 report, All 
en Minicomputers (70C-010-20, dated September 
1975). 


The Results for 1975 


Our comprehensive questionnaire asked each Datapro 
subscriber to describe his computer installation in 
considerable detail. Each respondent was asked to identify 
the manufacturer and model number of the computer 
system, the number of systems installed, the main 
memory size, the operating system in use, and the number 
of months the system has been installed. 


Another question asked whether the user acquired his 
system by outright purchase, rental from the manufac- 
turer, or through a third-party leasing arrangement. The 
results, summarized in Table 1 and detailed in Table 6, 
represent the percentages of the total number of responses 
for each manufacturer or model that reported each 
method of acquisition. Some respondents failed to supply 


TABLE 1: METHOD OF ACQUISITION 


Rental from Third-Party 
Manufacturer Manufacturer Lease 


Burroughs 
Controt Data 
DEC 
Honeywell 
IBM 

NCR 


Xerox 


Totals 
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TABLE 2: PRINCIPAL APPLICATIONS 


Business Data Scientific and 
Processing Engineering 


Burroughs 94% 
Control Data 60% 
DEC 44% 


Honeywell 96% 
IBM 92% 
NCR 91% 
Univac 85% 
Xerox 56% 


Totals 90% 


an answer to the question, while others had used more 
than one method of acquisition. As a result, the 
percentages do not always add up to 100%. 


We then asked our subscribers to describe the major 
functions of each computer system by indicating the 
principal application, or applications, performed by each 
system. The results are summarized in Table 2 and 
detailed in Table 6. Here the percentages nearly always far 
exceed 100%, indicating that most of the computer 
systems represented in the survey perform a variety of 
functions. Not surprisingly, with the exception of the 
computers made by Control Data, Digital Equipment 
Corporation, and Xerox, the emphasis is still heavily in 
the area of business data processing. The next highest 
activity is represented by data communications, with data 
base management ranking third. The high percentages in 
the “Others” category for Control Data and Digital 
Equipment are comprised mainly of entries for instruc- 
tion, research, and administration in educational institu- 
tions. 


The next question asked the computer users “Who wrote 
the programs for your applications?” Table 3 summarizes 
their replies. Although the vast majority of users maintain 
in-house programming staffs, most also have turned to 
other sources for programming assistance. Hence, the 
figures in Table 3 also total more than 100 percent in 
most cases. 


Computer users represented in the survey relied most 
often on software packages supplied by independent 
software houses to supplement their in-house pro- 
gramming efforts. These results underscore the growing 
importance of proprietary software industry in the 
computer marketplace. The percentages listed in Table 3, 
however, probably underestimate the full extent of the 
utilization of proprietary software packages by computer 
users; Our question specified application programs only, 
and many of the popular proprietary software programs 
supplement the services performed by the computer 
manufacturers’ systems software. 


The percentages of computer users in the survey who were 
using remote batch and/or interactive terminals varied 
widely. But all of the manufacturers had some 
representation in both categories, as shown in Table 4. 
Overall, nearly one-third of the computer systems 
represented in this survey were equipped with remote 
batch terminals, and just short of one-half of the systems 
included interactive terminals in their configurations. 
Although the number of each type of terminal installed 
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Real-Time 
Control 


Data Commu- Data Base 
nications Management 


20% 
36% 
16% 
25% 
24% 

9% 
24% 
32% 


24% 


per system naturally varied widely with the size of the 
computer system and the data processing environment, 
the averages were 4 remote batch terminals and 27 
interactive terminals per system. 


The next question relating to the description of each 
configuration asked the users to specify what types of 
peripheral devices, if any, they had obtained from sources 
other than their mainframe manufacturer. The results are 
shown in Table 5. Responses in the “Other Devices” 
category included printers, graphic plotters, MICR 
devices, and various types of remote terminals and 
front-end communications processors. As expected, the 
use of “foreign” peripheral devices is most common 
among users of IBM computers, who can choose from a 
wide variety of plug-compatible devices. But the figures 
also make it clear that many users of other makes of 
computers are now looking to alternative sources for some 
of the peripheral equipment. 


The answers to many of our questions concerning the size, 
longevity, method of acquisition, and principal applica- 
tions of each computer system are detailed in Table 6. 
The responses for each computer system and the totals for 
each manufacturer are tabulated to help establish a proper 
frame of reference for the users’ ratings which appear in a 
similar format in the following table. 


Table 6 also indicates that some of the computer 
hardware represented in this survey has had a far longer 
life expectancy than might have been predicted in view of 
the rapid pace of technological innovation and the regular 
arrival of new families offering ever more attractive 
price/performance ratios and more appealing processing 
facilities. The durable IBM System/360 still constitutes 19 
percent of the computers represented in this survey, with 
an average of 48 months of service. Other systems with 
notable longevity include the IBM 1130, with an average 
of 79 months, or over 6 years, of use, and 17 IBM 1401 
systems that have been in use for nearly a decade. The 
overall average number of months in use for all systems 
was 34 months, or just under three years. 


Finally and most importantly, in order to determine the 
level of the users’ satisfaction with their computer 
systems, we asked each respondent to judge his system in 
12 distinct categories of performance by assigning ratings 
of Excellent, Good, Fair, or Poor. These responses were 
grouped by computer model, and a weighted average based 
on the number of responses for each category was 
computed. To calculate the weighted averages, each 
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TABLE 3: SOURCES OF APPLICATIONS PROGRAMS 


Computer 
In-House P 


Personne! 


Manufacturer’s 


Personne! 


Burroughs 
Control Data 
DEC 
Honeywell 
IBM 

NCR 

Univac 
Xerox 


Totals 


<> Excellent response was weighted as 4, Good as 3, Fair as 


2, and Poor as 1. The total numbers of responses were 
multiplied by their corresponding weights, and the sums of 
these products were then divided by the total number of 
responses in each category. The results for each computer 
model that was rated by two or more users and the totals 
for each mainframe manufacturer are presented in Table 
cp 


Some Mixed Emotions 


In order to establish a base line or standard of 
performance, the ratings received by all computer systems 
in this survey are summarized in the Grand Totals row at 
the end of Table 7. These averages have been calculated to 
form an overall picture of user satisfaction, and in some 
cases dissatisfaction, with the currently installed computer 
equipment. 


In the important “bottom line” category of Overall 
Satisfaction, the respondents to the Datapro 1975 survey 
bestowed an overall rating of 3.1, or slightly better than 
Good, upon all the computer systems evaluated this year. 
In fact, average ratings of Good (3.0) or better were 
achieved in 9 out of the 12 performance categories. 
However, not one mainframe manufacturer scored 3.0 or 
better in all 12 categories, indicating that, according to 
these computer users, the products and services offered by 
all of the computer manufacturers could stand improve- 
ment. 


The highest level of satisfaction was achieved in the 
category of Reliability of Mainframe, the category which 


TABLE 4: REMOTE TERMINAL USAGE 


Remote Batch 
Terminals 


Burroughs 
Control! Data 
DEC 
Honeywell 
IBM 

NCR 

Univac 
Xerox 


Interactive 
Terminals 


Total 
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Used 
*"Ready-Made” 
Programs from 

Manufacturer 


Used 
Proprietary 
Software 
Packages 


Used Contract 
Programming 
House 


also achieved the highest rating in Datapro’s 1974 survey. 
Two other categories in which relatively high ratings were 
achieved were Ease of Operation and Responsiveness of 
Maintenance Service, categories which also scored well in 
1974. 


The major sources of user grievances also haven’t changed 
substantially since last year. Technical support for 
software is probably the cause for more discontent than 
any other area of interaction between mainframe suppliers 
and computer users, as expressed both in this annual 
survey and in the telephone interviews that are conducted 
in association with the preparation of individual computer 
system reports for DATAPRO 70. Users frequently cite 
deficiencies in terms of a lack of personnel and/or 
inadequate training of the available people, particularly in 
the case of newly released software. Very few mainframe 
vendors have been immune from criticism of some aspect 
of their software support services; in this survey the 
highest average user rating earned by any manufacturer 
for the quality of its technical support was only 2.9—and 
that score was achieved by Xerox Corporation, which 
recently announced its withdrawal from the mainframe 
business. 


Other areas in which these computer users expressed 
displeasure with the mainframe vendors was in the quality 
and selection of applications programs, where only Xerox 
earned a Good rating, and in the Ease of Conversion 
category, in which only Digital Equipment, NCR, Xerox, 
and Burroughs scored 3.0 or better. 


TABLE 5: USAGE OF ’FOREIGN” PERIPHERALS* 


Mainframe Magnetic Add-On Other 
Manufacturer Tape Drives | Main Memory | Devices 


Burroughs 
Control Data 
DEC 
Honeywell 
IBM 

NCR 

Univac 
Xerox 


Total 


*Peripheral devices obtained from sources other than the main- 
frame manufacturer. 
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TABLE 6: DETAILED COMPUTER ACQUISITION AND APPLICATION DATA 


Method of Principal 
Acquisition, Applications, 
Average % % 
Length 
of Time 
in Use, 
Months 


Average 
No. of Main 
Manufacturer and Computers | Memory 
Model Repre- Size, 
sented K Words 
or Bytes 


Rental from 
Manufacturer 
Third-Party 
Lease 
Business Data 
Processing 
Scientific/ 
w= OOOO | Engineering 
Other 
Applications 


Burroughs B 300 & B 500 
Burroughs B 1700 
Burroughs B 2500 
Burroughs B 2700 
Burroughs B 3500 
Burroughs B 3700 
Burroughs B 4700 
Burroughs B 5500 & B 5700 
Burroughs B 6700 
Burroughs, others 


OWMONDOAHROOO 
OoOmo-OD0OWO00 


BURROUGHS TOTALS 


Control Data 3000 Series 
Control Data 6000 Series 
Control Data Cyber Series 
Control Data 7600 
Control Data, others 


CONTROL DATA TOTALS 


Digital Equip. DECsystem-10 


N 
aS 


DIGITAL EQUIP. TOTALS 


Honeywell Model 58 
Honeywell Series 200 
Honeywell Series 2000 
Honeywell Series 60 
Honeywell Series 600 
Honeywell Series 6000 
Honeywell G-400 Series 
Honeywell, others 


= 


Oooo OAS 


= ~~ 
WORTONNO 
N 


p> 


HONEYWELL TOTALS 


IBM 360/20 
IBM 360/22 
IBM 360/25 
IBM 360/30 
IBM 360/40 
IBM 360/50 
IBM 360/65 
IBM 360/67 
(BM 360/75 
IBM System/360, others 


om 
Nooor270]}000 


ob 


oN 


IBM System/360 Totals 


IBM 370/115 
IBM 370/125 
IBM 370/135 
IBM 370/145 
IBM 370/155 & 155 II 
IBM 370/158 
IBM 370/165 & 165 II 
IBM 370/168 
| IBM Systern/370, others 


CONT OoOnMTw= 


Oo 


IBM System/370 Totals 
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TABLE 6: DETAILED COMPUTER ACQUISITION AND APPLICATION DATA (Continued) 


Method of 
Acquisition, 


Principal 
Applications, 


Average 


9 
N f No. of Main Tae de : 
Manufacturer and dae Computers | Memory : 
User 2 of Time 
Model : Repre- Size, ff 
Replies sented K Words nee, 
Months 
or Bytes 


Manufacturer 
Business Data 
Processing 
Engineering 
Real-Time 
Control 

Data Base 
Management 
Applications 


Scientific/ 


Third-Party 


Rental from 
Lease 


IBM System/3 2 8 111 
IBM System/32 0 0 (8) 
IBM 1130 3 9 |30 
IBM 1401 0] Oo (12 
IBM 1800 90 Oo {20 
IBM, others 0 0 0 
IBM TOTALS 6 24 8 
NCR Century 50 & 100 0 17 (17 
NCR Century 101 & 151 Q 16 | 21 
NCR Century 200 & 201 0 8 [22 
NCR Century 251 & 300 10 0 0 
NCR Century Totals 10 417 
NCR 315 O |43 
NCR TOTALS 19 
Univac Series 70 (ex RCA) 13 8 
Univac 9200 0) 8) 
Univac 9300 0 |27 
Univac 9400 & 9480 33 0 
Univac 9000 Series Totais 11 11 
Univac Series 90 25 13 
Univac 1106 50 |14 
Univac 1108 29 0 
Univac 1110 29 114 
Univac 1100 Series Totals 37 9 
Univac, others 13 113 
UNIVAC TOTALS 24 |11 
Xerox Sigma Series 32 {411 
Xerox 530 O 433 
Xerox, others 67 0 
XEROX TOTALS 32 |12 
RECAP OF TOTALS 

BY MANUFACTURER 

Burroughs 20 |12 
Control Data 36 |22 
Digital Equipment 16 |40 
Honeywell 25 6 
{BM 24 8 
NCR 9 119 
Univac 24 11 
Xerox 32 12 
Totals for manufacturers 22 13 
other than IBM 

GRAND TOTALS 24 9 
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TABLE 7: USERS’ RATINGS 


Weighted Average User Ratings* 


No. of 
Computers 
Repre- 
sented 


No. of 
User 
Replies 


Manufacturer and 
Model 


Operation 
Reliability of 
Mainframe 
Reliability of 
Peripherals 
Responsiveness of 
Maintenance Service 
Effectiveness of 

“| Maintenance Service 
Technical 
Operating 
Compilers and 
Assemblers 
Applications 
Programs 
Programming 
Conversion 

"| Satisfaction 


Burroughs B 300 & B 500 
Burroughs B 1700 
Burroughs B 2500 
Burroughs B 2700 
Burroughs B 3500 
Burroughs B 3700 
Burroughs B 4700 
Burroughs B 5500 & B 5700 
Burroughs B 6700 
Burroughs, others 


BURROUGHS TOTALS 


Control Data 3000 Series 
Control Data 6000 Series 
Control Data Cyber Series 
Control Data 7600 
Control Data, others 


CONTROL DATA TOTALS 
Digital Equip. DEC-system 10 
DIGITAL EQUIP. TOTALS 


Honeywell Model 58 
Honeywell Series 200 
Honeywell Series 2000 
Honeywell Series 60 
Honeywell Series 600 
Honeywell Series 6000 
Honeywell G-400 Series 
Honeywell, others 


HONEYWELL TOTALS 


IBM 360/20 
IBM 360/22 
IBM 360/25 
IBM 360/30 
IBM 360/40 
IBM 360/50 
1BM 360/65 
IBM 360/67 
IBM 360/75 
IBM System/360, others 


{BM System/360 Totals 


IBM 370/115 

IBM 370/125 

{BM 370/135 

| IBM 370/145 

IBM 370/155 & 155 Il 
IBM 370/158 

IBM 370/165 & 165 II 
IBM 370/168 

IBM System/370, others 


A 


IBM System/370 Totals 


*Basis is 4 for each user rating of Excellent, 3 for Good, 2 for Fair, and 1 for Poor. 
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TABLE 7: USERS’ RATINGS (Continued) 


Weighted Average User Ratings* 


N f No. of 3 2 
Manufacturer and sp Computers es > 5 
Repre- o)/*+ oO 
Model Replies Pp a fi 3 ” OW Ce} 
sented o o co g 9 5 “ mo 
el >@l a2] Selec] _ = at | so § i) 
S| Seles) 22/82] Se] fe] sol se B13 
OS/BE)/BL2)/ s8/ES esl SE! SE] Ss o/s 
o5,/S 6,82) e£/8e/2£21/ 52) es | ae >| 2% 
wo © —_ “a -_—<“s. Wom we “om oa a w g oO c ® c~] 
oa @ 8 oo oO] = Oo os as. oO ac: ° > 
wOolesS|oerd| ec slus|raloal oat] da o/0%8 
IBM System/3 3.7 | 3.4 3.5 3.0 | 3.3 | 3.3 3.4 
IBM System/32 3.3 2.7 


IBM 1130 
IBM 1401 
IBM 1800 
1BM, others 


{BM TOTALS 


NCR Century 50 & 100 

NCR Century 101 & 151 
NCR Century 200 & 201 
NCR Century 251 & 300 


NCR Century Totals 

NCR 315 

NCR TOTALS 

Univac Series 70 (ex RCA) 


Univac 9200 
Univac 9300 
Univac 9400 & 9480 


Univac 9000 Series Totals 
Univac Series 90 


Univac 1106 
Univac 1108 
Univac 1110 


Univac 1100 Series Totals 


Univac, others 
UNIVAC TOTALS 


Xerox Sigma Series 
Xerox 530 
Xerox, others 


XEROX TOTALS 


RECAP OF TOTALS 
BY MANUFACTURER 


Burroughs 

Control Data 
Digital Equipment 
Honeywell 

IBM 

NCR 

Univac 

Xerox 


Totals for manufacturers 
other than IBM 


GRAND TOTALS 


*Basis is 4 for each user rating of Excellent, 3 for Good, 2 for Fair, and 1 for Poor. 
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TABLE 8: MANUFACTURERS’ RANKINGS ACCORDING TO 
WEIGHTED AVERAGE USER RATINGS 


Ease of operation 
Reliability of mainframe 
Reliability of peripherals 
Responsiveness of 
maintenance service 
Effectiveness of 
maintenance service 
Technical support 
Operating systems 
Assemblers and 
compilers 
Applications programs 
Ease of programming 
Ease of conversion 
Overall satisfaction 


*Tie 


The Accolades for 1975 


This year Burroughs Corproation again leads the list for its 
software, scoring a top rating of 3.7 in the Operating 
Systems category and 3.5 for its Compilers and 
Assemblers. Digital Equipment and Xerox again received 
ratings well above the average in these two important 
software categories. 


Only three manufacturers—Digital Equipment, Xerox, and 
IBM—were given ratings above the industry average in 
Overall Satisfaction, with Digital and its DECsystem-10 
computers leading the others for the second year in a row 
with an impressive 3.4 rating. Two other mainframe 
vendors, Burroughs and NCR, equalled the overall average 
of 3.1 achieved by all the computer systems represented 
in this survey. 


Leaders in other rating categories include Xerox in 
Reliability of Mainframe, IBM in Reliability of Periph- 
erals, Burroughs in Ease of Operation, and Digital 
Equipment in Ease of Programming, Ease of Conversion, 
and Responsiveness of Maintenance Service. DEC and IBM 
tied for top honors in Effectiveness of Maintenance 
Service. 


The relative rankings of the 8 mainframe manufacturers in 
all 12 rating categories, as determined by the weighted 
average user ratings, are listed in Table 8 to help you 
pinpoint the relative strengths and weaknesses of the 
various manufacturers as judged by their own users. Please 
keep in mind that these rankings are necessarily based on 
widely varying sample sizes, ranging from 1,448 user 
responses for IBM down to 25 responses for both Digital 
Equipment and Xerox. 
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Control Digital 
Burroughs Data Equipment | Honeywell 
1 6* 2 6* 4* 6* 4* 3 


Since IBM computer systems comprised some 72% of the 
total computer systems represented in our survey this 
year, their users’ responses naturally had a strong effect 
on the overall ratings for all computer systems. In order to 
see how all the non-IBM computer systems stacked up 
against the manufacturer that controls the largest section 
of the general-purpose computer market, we calculated a 
set of weighted averages that exclude the IBM users’ 
responses (the second last line in Table 7). Non-IBM 
systems were rated higher than IBM systems in the 
following four categories: Ease of Use, Operating Systems, 
Ease of Programming, and Ease of Conversion, and they 
equal IBM’s ratings for Compilers and Assemblers and for 
Application Programs. In terms of overall satisfaction, the 
non-IBM computers’ 3.1 average rating barely missed 
matching IBM’s overall score of 3.2. 


Just what constitutes overall user satisfaction is a subject 
we haven’t explored, but factors such as attractive 
price/performance, sophisticated software, industry exper- 
tise, and specialized computing facilities are often cited as 
reasons for selecting a given computer system and staying 
with it. 


Thank You 


Datapro wishes to thank all of our subscribers for 
responding so enthusiastically to our second major survey 
of user experience with general-purpose computer 
systems. Without your participation, it could not have 
been a success, and we hope that this compendium of the 
opinions of your colleagues will be of significant value to 
you. We look forward to hearing from you again next 
year.0 
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